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Abstract 

We investigate whether uncoded schemes are optimal for Gaussian sources on multiuser 
Gaussian channels. Particularly, we consider two problems: the first is to send correlated Gaus¬ 
sian sources on a Gaussian broadcast channel where each receiver is interested in reconstructing 
only one source component (or one specific linear function of the sources) under the mean 
squared error distortion measure; the second is to send vector Gaussian sources on a Gaussian 
multiple-access channel, where each transmitter observes a noisy combination of the source, 
and the receiver wishes to reconstruct the individual source components (or individual linear 
functions) under the mean squared error distortion measure. It is shown that when the channel 
parameters match certain general conditions, the induced distortion tuples are on the boundary 
of the achievable distortion region, and thus optimal. Instead of following the conventional 
approach of attempting to characterize the achievable distortion region, we ask the question 
whether and how a match can be effectively determined. This decision problem formulation 
helps to circumvent the difficult optimization problem often embedded in region characteriza¬ 
tion problems, and also leads us to focus on the critical conditions in the outer bounds that 
make the inequalities become equalities, which effectively decouples the overall problem into 
several simpler sub-problems. 


1 Introduction 

Although the source-channel separation architecture is asymptotically optimal in the point-to-point 
communication setting 111 as well as several classes of multiuser communication settings (see e.g., [2 
and references therein), uncoded schemes have several particularly attractive properties. Firstly, 
they have very simple encoders and decoders; secondly, they belong to the so-called zero-delay 
codes, which can avoid the long delay required to approach the asymptotic performance in the 
separation-based schemes; lastly, they are in fact optimal in some settings, while the separation- 
based schemes are not (see e.g., @). 

It was shown in |4j that uncoded schemes are optimal when certain matching conditions involv¬ 
ing the source probability distribution, the channel transition probability distribution, the channel 
cost function and the distortion measure function are satisfied. Though the focus in |4| was mainly 
on the point-to-point setting, recent results [h|j8] suggest that the concept of matching indeed carries 
over to the multiuser case. In fact, in multiuser settings, matching may occur naturally when the 
distortion measure, the channel cost function and source distribution are all fixed, and the channel 
parameters, which represent physically meaningful quantities, satisfy certain conditions. In this 
work, we consider such matching, particularly, when the sources and the channels are Gaussian, 
the channel constraints are on the expected average signal power, the distortion measure is the 
mean squared error (MSE), and only the channels parameters, such as the channel amplification 
factors and the additive noise powers, are allowed to vary. 
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In this context, of interest is whether for a fixed source and fixed coding parameters, the 
distortion vector such induced is on the boundary of the achievable distortion region (and thus 
optimal). More specifically, we seek to answer the following questions: 

• Is there a set of (explicitly) computable conditions that can be used to certify a fixed uncoded 
scheme to be optimal for a given source and channel pair? 

• If so, is there a non-trivial set of channels that satisfy such conditions for a given source and 
uncoded scheme pair? 

We shall refer to this kind of channels as “matched channels”; a dual question is to ask for 
“matched sources”, however in the context of problems considered here, the dual question is no- 
tationally more involved, and thus we choose to investigate the problems from the perspective of 
“matched channels”. One can also ask for “matched distortion measures”, similarly as the approach 
taken in |4|, however in the Gaussian setting we consider here, fixing the MSE distortion is prac¬ 
tically more important and well-motivated. The set of matched channels should be distinguished 
from the complete set of channels for which the given uncoded scheme is optimal. The former may 
be a strict subset of the latter, since the former may be only sufficient for an uncoded scheme to be 
optimal, which usually depends on the specific outer bounding technique employed. Characterizing 
the latter region is naturally more difficult than answering the questions we posed above. 

The two questions posed above are in essence the two facets of the same question. Since we 
only provide conditions for matching, or in other words, sufficient conditions for the scheme to 
be optimal, the set of matched channels may in fact be empty. A trivial condition to answer the 
first question is simply an impossible one such that we would never be able to certify a channel 
to be matched. Thus the second question is important, and we show indeed for the two problems 
considered here, there are non-trivial channels that match the source and the uncoded scheme. 

Traditionally, research in information theory asks for characterization of certain achievable re¬ 
gion, for which we first derive an expression for an outer bound, and derive an expression for an inner 
bound, and then make comparison of them. This approach can be challenging because it usually 
involves optimization over a set of parameters, and solving such an optimization problem explicitly 
can be difficult. It is not clear whether the obstacle mainly stems from the intractable nature of the 
underlying communication problem, or it is mainly caused by the embedded optimization problem. 

The aforementioned difficulty motivates the formulation of the first question, which is a decision 
problem instead of an optimization problem. An analogy of this situation can be found in computer 
science algorithm research, where instead of asking whether an optimization problem can be solved 
in polynomial time, the alternative question is asked whether a decision ( e.g ., regarding a solution 
is above a threshold) can be made in polynomial time. Our problem formulation naturally leads to 
a different approach in the investigation. Instead of focusing on comparison of the inner bounds and 
outer bounds using their expressions, we focus on the necessary conditions that the outer bound 
becomes tight, i.e., the conditions when the information inequalities hold with strict equality. 
With fixed source and fixed coding parameters, the coding vector can be substituted into the 
conditions, and the necessary and sufficient conditions for such equality can be derived. The outer 
bounds naturally provide certain “decoupled” conditions, which significantly simplifies the overall 
task. Though this approach may have inherently been used by many researchers in the past, its 
effectiveness becomes particularly evident in our investigation of uncoded schemes in the joint 
source channel communication setting. 

In the rest of the paper, we focus specifically on two joint source channel coding problems using 
the approach outlined above. The first problem is to send correlated Gaussian sources on a Gaussian 
broadcast channel where each receiver is interested in reconstructing only one source component 
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(or equivalently one specific linear function of the source) under the MSE distortion measure. The 
second problem is to send vector Gaussian sources on a Gaussian multiple-access channel, where 
each transmitter observes a noisy combination of the source, i.e., a case of the vector CEO problem, 
and the receiver wishes to reconstruct the source components (or equivalently linear functions of 
the source components) under the MSE distortion measure. General conditions for matching are 
derived, which either include or generalize well-known existing results on the optimality of uncoded 
schemes in the multiuser setting. Particularly notable are the following cases: 

• The first problem generalizes the two-user case considered in |5] and |6] to the M-user case, 
for which we show that the uncoded scheme is optimal for a large set of sources and channels; 
our results reveal that uncoded scheme can still be optimal when some source components 
are negatively correlated. 


The results on the second problem includes as specials cases the symmetric scalar Gaus¬ 
sian CEO problem (T], the problem of sending bivariate Gaussian sources on a Gaussian 
multiple-access channel |8|, and sending remote (noisy) bivariate Gaussians on a Gaussian 
multiple-access channel |9|. Our results reveal that in addition to the symmetric case consid¬ 
ered in [7| , uncoded scheme is also optimal when the sensor observation quality is proportional 
to the channel quality. These results also allow the sensor observations to have more gen¬ 
eral correlation structure and the observations to be noisy, thus extending the results in [8]| 
and 91. When viewed from the perspective of computation, our result also provides new 
characterizations for the problem of computing linear functions of Gaussian random variables 
on the Gaussian multiple-access channels considered in 
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Notationally, we write for a source S at time n as S[n], and a length -N vector as S N . For a set 
of coefficients (on, 0 : 2 , • ■ • ,0m)) we sometimes write it in a (column) vector form as a. For a real 
matrix E, we write its transpose as Eh The positive semidefinite order is denoted as y. 


2 Correlated Gaussian Sources on a Gaussian Broadcast Channel 


In this section we consider the problem of broadcasting correlated Gaussian sources on a Gaussian 
broadcast channel, which can be described as follows; see also Fig. [l] for an illustration. Let the 
zero-mean Gaussian source be (Si [ra], S 2 [n],..., Sm [n]) with covariance matrix Ewhich 
is assumed to be full rank. The channel is given by 

Y m [n] = X [n] + Z m [ n ], (1) 


where (Z\, Z 2 ,..., Zm) are zero-mean additive noises which are mutually independent, with vari¬ 
ances > cr^ 2 > ... > o\ , respectively; the channel input must satisfy an average power con¬ 
straint Y2n=i ^X 2 < P. The transmitter encodes the length-IV source vector (S^ , 5^,..., S 
into a length-IV channel vector X N , and the m-th receiver reconstructs from the channel output 
vector Y* the source vector as S^, resulting in a distortion D rn = J2n=i E ( S m [n\ - s m [n}) 2 . 
We omit the formal problem definition using encoding and decoding function, which is standard 
and can be obtained by extending that in, for example, |6|. 

The uncoded scheme of interest has the form 

M 

X[n] = ^2 amS m [n], (2) 

m= 1 

such that 


E[X 2 [n}} = P. 


(3) 
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Figure 1: Sending correlated Gaussian random variables on a Gaussian broadcast channel. 


In other words, at each time instance, the channel input is simply a linear combination of the 
source components with coefficients (aq, « 2 ,..., ajf)i such that the resulting signal has an expected 
variance that is equal to the power constraint P. We shall assume at m ^ 0. The decoders simply 
estimate S m [n] as S m [n] = E(5 m [u]|y m [n]), at each time instance n = 1,2, ...,N at decoder 
m = 1,2,..., M. Notice that the problem can be equivalently formulated as computation of linear 
functions of Gaussian sources on the broadcast channel, however this alternative formulation is 
notationally more involved. 

Define 

P = (£l) $2) • • • , PmY ~ -p'£‘S 1 ,S 2 ,-,S M ®- ( 4 ) 

The main result is summarized in the following theorem, which gives a matching condition in a 
positive semidefinite form. 


Theorem 1. A Gaussian broadcast channel is said to be matched to a given source and an uncoded 
scheme with non-zero parameters a, and the distortion vector induced by the given scheme is on 
the boundary of the achievable distortion region thus optimal, if 

£ (0) = £d,W-,Vm - £ Si ,5 2 „..,Sm + Pffi ± (5) 

where the entries of the symmetric matrix Ey, are specified as 


1j,m — Prnff 


Pal 

_ Ztm 

J P + a 2 z 

Z/rt 


1 < j < m, m = 2,3,..., M, 


T m,m — 


m— 1 

0m{ ^ ^ ft j ) 


Pal 

Z/rt 


M 


Pal 


3 = 1 


jnJ P + a 2 


+ Pm a jPj 

j =772+1 


^ ~J-Jp + a 2 


( 6 ) 


m = 1,2, (7) 


This theorem establishes a condition that is sufficient to guarantee a distortion vector induced 
by an uncoded scheme to be on the boundary of the achievable distortion region, and thus an 
optimal solution. The matrix Ey y 2 ....y M may seems mysterious at the first sight, however, the 
reason for introducing this matrix will become clear shortly. 

This theorem clearly answers our first question regarding conditions that can be used to certify 
whether a given uncoded scheme is optimal. In fact, it also provides clues on the second question 
regarding whether there exist non-trivial channels that such matching is possible. Indeed, in Section 


2.3 and Section 2.4 we establish several properties of matched channels, through which an answer to 
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the second question is given. Before presenting those results, the proof of this theorem is presented 


next in two parts: the critical conditions in a novel outer bound are outlined in Section 2.1, and 
then these conditions for the bound to hold with equality in the uncoded scheme are analyzed in 
Section |2.2[ The proof details for the outer bound are relegated to the Appendix. 


2.1 Extracting the Critical Conditions from the Outer Bound 

In order to obtain the matching condition, we first derive a novel outer bound for this problem. 
An important technique in the derivation of this outer bound is the introduction of certain appro¬ 
priate random variables outside of the original problem. This approach is partly motivated by our 
previous work 12-15 , which can further be traced back to Ozarow 16 . Consider M zero-mean 


Gaussian random variables {W\, W 2 , • • •, Wm ), independent of everything else, with covariance ma¬ 
trix £wi,W2,...,w M 5 an d write 

U m [n\ = S m [n\ + W m [n\. (8) 

The outer bound will be written as a necessary condition that any distortion vector has to satisfy. 
For this purpose, we bound the following quantity for any encoding and decoding functions: 

M 


E(V Wl , Wa ,..., WM ) = _ a Zm+l ) eX P 


m= 1 


m 


N 

3 = 1 


(9) 
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to obtain 


where i = 0 for notational simplicity. An almost identical quantity was used in 
an approximate characterization for the distortion region of the Gaussian broadcast problem with 
bandwidth mismatch. We shall upper-bound this quantity using the channel properties and lower- 
bound it using the source reconstruction requirements, then combine them to obtain an eventual 
outer bound. 

This quantity can be upper-bounded as given in the Appendix as 

E (^W U Wn,...,W M ) < -P + cii, 

with equality holds if and only if 

K y m\Si , Sf, ...,SZ) = h(Y$\U?, U 2 n , 


( 10 ) 


tt n ) 

' u M)i 


N . 


h(Y\ ) = y log27re(P + (T Zl ), 
and the following condition stemming from the entropy power inequalities hold with equality 


( 11 ) 

( 12 ) 


exp 


—h(Y N 
N [ r 


tj n jjN 
m I ^ m 5 w m— 


n N \ 

1 , ■ • •, u i ) 


= exp 




• u, N ) 


+ 27 re[cr| m - cr| m+1 ], 


m = 1,2,, M. 


(13) 


The conditions in (13) are standard, as Bergmans 17 also used the entropy power inequality 


to establish the Gaussian broadcast channel capacity, and in general a Gaussian codebook suf¬ 


fices to make them equalities. The condition (12) intuitively requires that the power is fully uti¬ 


lized. The condition 0 is however rather peculiar, which essentially requires the noisy source 
(UZ, , ■ ■ ■, Ufri) to be as useful as the real source (S'j V , S 2 , • • •, S^) i n determining the channel 
output Y$. 

The quantity E(Ewi,W 2 ,...,w m ) can a ^ so b e lower-bounded as given in the Appendix, where its 
individual summands are bounded as 


exp 


N 


Ywf-.Yfwr.u?, 

3 = 1 


,U 


N 


3 ~ 


> 


\^S U S2,...,Sm + S Wl,W 2 ,..., 


Wrr 


n T=i( d 3 + ^ 


(14) 


Wi 
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with equality holds if and only if 

h(U, N 


V 


N\ 


N . 


m rm ) = y log [2ire(D m + o w J\, m = 1,2.. 


.M. 


HU, 




V JV TT 

m\ ± m i w 1 




■ •, U^-x) = h{UZ IO, m = 2, 3,..., M. 


rJVlvJV 


(15) 

(16) 


The conditions in (15) are standard which can be viewed as requiring the codes to achieve the given 


distortions with equality, however the conditions in (16) are peculiar which essentially require all 
the information (T„ Y , t/j Y , U 2 ,..., U^_ x ) on to be from 


Combining (10) and (14), we obtain an outer bound, or outer bounds since each set of the 


auxiliary random variables (Wi, W 2 ,..., Wm) provides one specific outer bound. In the approach 
we shall take, the precise form of this outer bound is less important than the extracted matching 
conditions ( [TT| ) , ( [12] ), (13), (15) and (16). In fact, the conditions (12), (13) and ( fl5| ) can be 
satisfied simply by choosing a proper jointly Gaussian coding scheme, yet the conditions © and 
(16) are the effectual non-trivial conditions. Note that from the problem setting and taking into 


consideration the fact that physical degradedness is equivalent to stochastic degradedness in the 
broadcast setting, we have the Markov string 


Yf Y 2 n 




+*Y$++X n ++{S?,S?,...,S%) 




N 


^ Um_ 1 ) 




<*u?, 


(17) 


where we have utilized the fact that physical degradation is equivalent to stochastic degradation in 
broadcast channels. This Markov string is not sufficient to guarantee © and ( [l6| ), and thus they 
require special attention. 


2.2 The Forward Matching Condition 


We first introduce some additional notation and make a few observations. Notice that due to the 

JT. A f_ _ _ _ w 


power constraint, the coefficient vector a = ( 011 , 0 : 2 , • • •, «m) should satisfy 


a t Ys 1 ,s 2 ,...,S M a = P - 


and it follows that 


M 

E 

m =1 


Q-mfim — 1* 


(18) 


(19) 


Due to the jointly Gaussian distribution of the uncoded scheme, we can write 

Um = /3 m X + (Sm — f5 m X) + W m , m = 1,2,..., M, (20) 

where the three components are mutually independent, since f3 m X = EfS'mlX]; we have also omitted 
the time index [n] to simplify the notation. It follows that the covariance matrix of (U\, U 2 , ■. ■, Um) 
given Y m can be decomposed as follows 

Pl Ui,U2,...,U M \Y m =a ‘x\Y m PP t + S Si,S 2 ,...,5m|X + Swi,W 2r ..,W M , (21) 

where 


2 

a x\Y m 


Pol 

_ X/m 

P + o%_ 


m = 1, 2,..., M. 


( 22 ) 


Let V m 4 (S m - p m X) + W m for m = 1, 2,..., M. 

With the above observations, we now return to the derivation of the forward matching condi¬ 
tions. As mentioned earlier, we need to substitute the random vectors specified by the uncoded 
scheme, i.e., assigning X [n] = a m S m [n], into the critical conditions (11), (12), (13), (15) 

and (|16[ ) in order to identify the matching conditions. It is straightforward to see that (12), (13) 
and (15) indeed hold with equality due to the jointly Gaussian distribution of the uncoded scheme, 
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and the chosen coefficients. Thus we only need to focus on (11) and (16), which in the context of 


(25) 


(26) 


the uncoded scheme are equivalent to the following single-letter forms 

h(Z M ) = h(Y M \Ui, U 2 ,..., U M ), (23) 

h(U m \Y m ,Ui,U 2 ,...,U m - 1 ) = h(U m \Y m ), m = 2,3,...,M. (24) 

To satisfy the condition (24) with the jointly Gaussian uncoded scheme, for any m = 2,3,, M, 
we must have E[V m Vj] + (3 m /3ja 2 x | J: = 0 for j = 1, 2,..., m — 1. This specifies all the off-diagonal 
terms of 'Ev 1 y 2 ,...y M i as 

EfVjnVj] = r )m,j = X\Y m '> 1 — J ^ ^i 771 = 2, 3, ... , M. 

It remains to determine the diagonal entries of Tiv 1 y 2 ,...,v M - 
Since 

M M 

^ ) OimSm — 2C — ^ ) CH-mfimX , 
m= 1 m= 1 

in order to satisfy the condition ( |23| ) with equality, we must have 

M M 

^ ' (%mVm = ^ ] OtmWm = 0, (27) 

m= 1 m= 1 

where we have taken into account of the fact that £s 1 ,s 2 ,...,S M is full rank. Thus for any m = 
1,2,..., M, 

M M 

E ^nvmVj] = E[v m e = o. 
i=i 1=1 

It follows that 7 m im = <7y m can be determined from 

m— 1 M m —1 M 

= ~ E ~ E = ^ mCJ Ajy m E a l^l (T X|Y, ’ 

1 = 1 1=771+1 1 = 1 1=777+1 

since a m / 0. 

Thus the conditions (23) and (24) being equalities uniquely specify the matrix T, y. ,y 9 . 


(28) 


(29) 


Conversely, as long as the matrix Shu is positive semidefinite, the conditions (23) and (24) hold 


-,Vm- 


with equality and the corresponding auxiliary random variables (ITi, W 2 ,..., Wm) can be found, 
and the outer bound derived previously is thus tight. This is exactly the matching condition given 
in Theorem [TJ 

Remark: The outer bounds conditions and ( |16[ ) in the context of the uncoded scheme 
provide two constraints on the matrix £ v 1 y 2 ,...y M - Their effects on the matrix Ey 1 y 2 ,...,v M are 
largely decoupled: the condition required by ( [T7i] ) being equal determines the off-diagonal entries 
of E+i y 2 ,...,v M i while the condition ( pTTj ) determines its diagonal entries. This decoupling effect is 
particularly helpful in deriving the matching conditions. In the second problem we consider in 
the next section, i.e., the multiple access channel problem, this decoupling effect is even more 
pronounced. 


2.3 Cholesky Factorization and a Necessary Condition For Matching 

The condition given Theorem [l] is in a positive semidefinite form, however, due to the specific 
problem structure, it can also be represented as a set of recursive conditions, which is discussed 
in this section. This alternative representation also leads to a necessary condition for matching to 


hold, which plays an instrumental role for several results given in Section 2.4, where we answer the 


second question regarding the existence of non-trivial set of matched channels. 
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Determining whether a matrix is positive semidefinite is equivalent to computing the LDL 
decomposition, and checking whether the resultant diagonal matrix in the decomposition has non¬ 
negative entries. The matrix £1°) is positive semidefinite if and only if the diagonal matrix in 
the LDL decomposition has only non-negative entries. Computationally this can be accomplished 
with the Cholesky factorization 19 on the matrix Here we provide an intuitive description 


of the Cholesky factorization in the context of the problem being considered, and its conceptual 
interpretation as the recursive thresholding determination for the channel to yield a matching. 

In the first step of the Cholesky factorization, we use symmetric column and row Gaussian 
elimination to eliminate all the entries of the M- th column and the M-th row, except the diagonal 
entry. Denote the resulting upper-left (M — 1) x (M — 1) matrix after this first step as A 

necessary condition for the matrix to be positive definite is that the lower right entry of the 
matrix is strictly positive, or all the entries on the last column are zero. Notice that the 
condition only involves &x\y m or the channel noise power which yields a necessary condition 
on u 2 Zm in the form of cr z > f(°\P, a). 

Continue the Cholesky factorization on and a similar necessary condition is its lower right 
entry is strictly positive, or the entries on the ( M — l)-th row of are zero. Similarly as the 
previous step, the condition on o\ f° un d to be in the form that cr| > /^(P, a, 4 M )- 

Continuing this process will yield a set of conditions in the form of 

> / (M - m) (P, d, 4 , al, a* ,..., a*), m = M,M- 1,..., 1. (30) 


4 

Zjn 


The matrix £(°) is positive definite if and only if all such threshold conditions are satisfied. 

Notice that the threshold function y( M - m )(p, a, 4 M > 4 M > (T l m _ x ) f° r 4 m depends on the chan¬ 
nel noise power values (4 M > a ‘z M _ 1 i ■■ ■ > 4 ra+ i)i but not on (a Zi , cr Z2 ,..., a Zm i ). Thus these 
functions /( m )(-), rn = M, M — 1,..., 1 can be viewed as a recursive threshold checking (or de¬ 
termination) procedure, and the channel noise power needs to be chosen to be larger than 
the threshold determined by (4 M > a z M x 5 - - - j a z m+1 ) i n ever y s t e P to yield a matching. Given the 
above observation, it is natural to speculate that if a channel is matched, then any more noisy 
channel also induces a match. This intuition is in fact correct, and the statement is made more 
rigorous in the next section as Corollary [l] 

One necessary condition for a matching to exist is that the matrix T,y 1 y 2 ,...,v M * s positive 
semidefinite. We can thus apply the Cholesky factorization technique on this particular matrix to 
obtain a necessary condition for matching to exist. 


Lemma 1. For the matrix Sy, .y 2 ,....v M constructed previously to he positive semidefinite (with 
4 m > 0), it must be true that a t (di > 0, i = 1, 2,..., M. 

Note that this condition is essentially independent of the channel, as long as the channel is not 
perfect. This lemma is proved in the Appendix. 


2.4 Properties and Existence of Matched Channels 

With Lemma 1, we can establish several properties of the set of matched channels, given next as 
corollaries to Theorem [lj Their proofs are provided in the Appendix. These properties essentially 
provide an answer to the second question posed earlier, and we shall also further illustrate such 
sources and channels using an example. 

Corollary 1 . If an uncoded scheme is matched on (<7 Zl , 4 2 j • • ■ > a z M )’ ^ en ^ matched and 
thus optimal on any channel with noise powers 4+ > 4+ > ... > 4+ where a 2 + > 4 , 

Zjc~, Zj », r Zim ^m 



The corollary reveals a property of matched channels: once a channel is matched, any channel 
with more noise is also a matched channel and thus the uncoded scheme is optimal. The next 
corollary states, from the perspective of only the source and the uncoded scheme parameters, the 
necessary and sufficient condition for matching to exist. 

Corollary 2. Matching (on a broadcast channel with finite noise powers) exists, if and only if 
a.ij3i > 0 and the matrix nSs ljl s 2j ... i s' M II has its largest eigenvalue being 1 with multiplicity 1, where 
II is a diagonal matrix with diagonal entries being 

«2 / 
sr^M 5 * ' ‘ M / sr-^M 

Mi= 1 P2,i&i y Mi -1 PM,iOti 

Moreover, if the above condition holds, then any channel with o Zi > <j\ 2 ... <j Zm > a z is a matched 
channel, where a 2 z = , and X 2 is the second largest eigenvalue of the matrix IIS 5 lj 5 2i ... ) 5 M n. 

Remark: If the entries of diag(d)S 5 1 ) 5 2 i ... ) 5 M diag(d) are strictly positive, then matching is 
always possible. This follows from the fact that the matrix IIEs^ s 2i . s M II has positive entries, and 
v\ = (i/opdi, yj 012021 •••) \ZchmPm) is its positive eigenvector, such that 1 is its largest eigenvalue 
with multiplicity 1 (by Perron-Frobenius Theorem 1201). 

Different from the case discussed in the previous remark, the next corollary gives another 
sufficient condition for matching to occur when the sources and the coding parameters satisfy the 
same positive correlation condition. 




Corollary 3. Let the entries of the matrix diag(a)Tj\y 1 ,W2,...,w M ^ a 9( a ) b e strictly positive. Denote 
the entries of ^Si,S 2 ,...,S M as Pi,i> an d define 

a z * = max p 2 _ f\ m = 2,3,...,M. (32) 

m J<m Pj,m 

Any channel with a 2 Zi > a 2 Zo > ... > o~'z M such that a Zm > a z * for m = 2,3,..., M is a matched 
channel. 


Remark: , as defined above may in fact be negative. However this does not cause any 

^ m 

discrepancy due to the requirement a 2 Zi > a 2 Z2 > ... > g 2 Zm . As a reality check, notice that 


M 


M 


J2( a iWmP) = PPm = (33) 

i =1 i=l 

but P^P < <Tg unless a\ = ot 2 = ... = cum- 1 = 0 , which however would contradict our assump¬ 
tion. It thus follows 


max ^d^rnP > ( 2 ^ 

j<M Pj,M 


and thus a z * > 0 always holds under the condition in the corollary. 

Remark: For the symmetric case where = cr|, O 5 . 5 . = p<r|, on = a and E[S)|X] 
z = l,2,...,M. A necessary and sufficient condition for matching is simply 

a z M > 1 ~ P 

P + °z u 1 + ( M - l )p 

To see this, notice that 

P = a 2 Mo 2 s [l + (M - l)p\. 


PX, for 


(35) 

(36) 
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Figure 2: Determining the (pi, P 2 ) pairs for which matching is possible, given in shade. 



and (3 can be computed as 


P = 


aM 


(37) 


Checking the first condition in the Cholesky factorization, it is easily verified that (35) is a necessary 


condition for matching. However, from Corollary [3j it is seen that it is sufficient to choose any 

32 




r i* 


where a \* = ~^P Z — P, m = 2, 3,, M. This is exactly condition (|35|). 


2.5 An Example: A Source with Three Components 

Let us consider a source with three components whose covariance matrix is either 

S 5i,5 2 ,5 3 = 

or 

£Si,S 2 ,S3 = 



Pi 

P2 

Pi 

1 

Pi 

P2 

Pi 

1 


P2 

Pi 

P2 

1 

Pi 

.Pi 

Pi 

1 


(38) 


(39) 


and further assume that the coefficients are chosen an = <22 = £*3 = 1 in the uncoded scheme. 
In addition to the constraint that the matrix Eg,.s 2 . 5 3 must be positive definite, for a matching 
to exist, the condition in Corollary [2] must be satisfied. It can be shown that the eigenvalues of 

nS Sli s 2i5;j n are 

— 2 p\ + P2 + 1 x 1 ~ P2 


Ai — 1, A 2 — 


A 3 — 


(40) 


2 Pi + c lp\P2 + 3pi + P2 + 1 Pi + P2 + 1 

and we must have A 2 < 1 and A 3 < 1. In the appendix, we show that the valid choices are the 
(PI 1 P 2 ) pairs such that 

P 2 < 1) 0 < pi < 1, pi + 2p2 >0, p 2 > 2 pi — 1. (41) 

The corresponding region is plotted in Fig [2} Notice that the two matrices are equivalent for the 
purpose of determining whether matching is possible, thus the region in Fig [2] is valid for both 
cases. 
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Figure 3: Illustration of the regions of matched channel parameters when (p\,p 2 ) = (|, |) for the 
two covariance matrices (38) and (39), respectively. 


Next let us fix a (pi, P 2 ) pair, and consider the region of ( 


Pu 2 7 

Z 2 


PcT^r 

z s 


pairs such that matching 


' p +°z 2 ’ p+*i a 

occurs. The tradeoffs can be computed explicitly, and are illustrated in Fig. [3] for (pi,P 2 ) = ( 5 , §)■ 
The circles in the plots give the channels specified by Corollary [2] The channels given by Corollary 
[ 3 ] can be computed directly (given as the dots), which is loose in the first case, but on the lower 
boundary (and it is an extreme point) for the second case. Since a\ > , we also include this 


'z-i - u z 2 > 

PcT^r 

boundary in the plot. For the first case, the boundary | < P is also shown, while for the 

+ < t z 3 

second, the lower bound y > required by the function /(°)(P, a) in the first step of the Cholesky 
factorization is shown. The corresponding channels that matching occurs are those inside the “fan” 
regions. Note that there is a tension between the noise powers and a 2 Z:i for matching to occur 
with for the fixed source and uncoded scheme. 


3 Vector Gaussian CEO on a Gaussian Multiple-Access Channel 

In this section we consider the problem of sending correlated Gaussian sources on a Gaussian 
multiple-access channel, where the transmitters observe noise linear combinations of the source 
components; see also Fig. [4] for an illustration. 

A zero-mean vector Gaussian source (Si[n], S 2 M) • • •, %[«]) has a covariance matrix £ s 1} s 2 ,...,S M ■ 
There are a total of L sensors, whose observations are (T) [n],T 2 [n],... ,Tf,[n]), respectively, with 
covariance matrix The sources and observations are jointly Gaussian. Each sensor 

observes , encodes it under an average transmission power constraint Pi , l = 1,2,... , L. The 
channel output is given as 

L 

Y[n]=Z[n] + ^2S e X t [n], (42) 

i= 1 

where 5i > 0. The receiver wishes to reconstruct (5^,5^,..., S^) using channel output Y N to 


11 













Figure 4: Sending correlated Gaussian random variables on a Gaussian multiple-access channel 
with noise observations. 

minimize the individual MSE measure, which achieves MSE distortion D m for S m , i.e., D m = 
~k En=1 E ( S <«H - Sm[n}) 2 . 

Notice that due to the jointly Gaussian distribution, we can write 

L 

E[S m \T u T 2 ,.. ., 7/J = S m = Y^m/Tt, rn= 1,2, (43) 

e=i 

The parameters 7 m £ can be conveniently written in a matrix form T, and computed as 

r = S (5i,5 2 > ...,5M) > (Ti,T 2 ,...,T i )Sr 1 1 ! T 2r .. jTi , (44) 

where ... : s m ),(t 1 : t 2 ,-,t l ) is the cross-covariance matrix between vectors (<Si, S2, • • •, Sm) and 

(Ti ,T 2 ,...',Tl). 

Notice that the problem can be equivalently formulated as computation of linear functions of 
Gaussian sources on the multiple-access channel. In this alternative setting, the functions to be 
computed are (S\, S 2 , ■ ■ ■, Sm), which can be represented as noisy linear functions of the sensor 
observations (Ti, T 2 ,. .., Tl). This alternative formulation is notationally more involved in the 
current problem setting, but we shall explore this connection in a separate work. 

We assume M < L, and consider the case that the matrices £s , 1 ,s 2 ,..., 1 S M , ^ ^ 

and 1 ,s 2 ,...,s m ),(Ti,t 2 ,...,t l ) a ll have full (row) rank, which hold in general except certain degenerate 
cases. Denote the entries of as ipij. The uncoded scheme we consider is 


Xe[n\ = rjeJ —T e [n}, £=1,2 (45) 

where r/e is either +1 or —1 to be specified next. In other words, each sensor sends its noisy 
observation directly using the full power, but it can choose whether to negate its observations. The 
m-th receiver estimates S m [n] as S m [n] = E[<S' m [ra]|Y’[n]]. 

Define 


— A 

a = h 


(5i,5 2 ,...,SM),(Ti,T 2 ,...,T i )^(5 1 ,S 2 ,...,5 M ),(ri,T 2 ,...,T i ) 


... n • s ^^l) 


and we assume a m / 0, m = 1, 2,..., M, which is true in general except certain degenerate cases. 
Our main result on this problem is summarized in the following theorem. 

Theorem 2. A Gaussian multiple-access channel is said to be matched to a given Gaussian source 
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and an uncoded scheme with parameters rj, and the distortion vector induced by the given scheme 
is on the boundary of the achievable distortion region and thus optimal, if 

1 • mrw'ipl,t> >0, [<£<£’< L; 

2. The vector ( Sirji $ 2 V 2 ^f^, • ■ •, T, Ti ,t 2 ,...,t l is in the row space of the ma¬ 

trix S (5lj52r .. j5M)i(Tl)T2i ... :Ti) ; 


3. — i~\o ’ w here A2 is the second largest eigenvalue of the matrix IIS 


-A2 

is a diagonal matrix with diagonal entries 


Si,S2,--,Sm 


a 1 


«2 




2^11= 1 Pl,i a i V /_ji= 1 P2,iOi\ 


M 




II, where II 


(47) 


and p m ,j’s are the entries of the matrix 


S a a 


Si,§2,...,Sm - T ‘{S 1 ,S2,-,Sm),(T 1 ,T2,...,T l )^t 1 ,T2,...,T l ^{S 1 ,S2,-,Sm),(Ti,T 2) ...,T l )- 


-i-l 


(48) 


These conditions can be intuitively explained as follows: condition one guarantees that the 
channel inputs from all transmitters coherently add up; condition two stems from the requirement 
that the noise observations should serve the same role as the underlying source for the chosen power 
constraints and amplification factors, i.e., as if the observation noise does not exist; condition three 
is similar to the effect in the previous problem where once a channel is matched, a more noisy 
channel will also induce a match. 

When all > 0, we can simply choose rj£ = +1 (or —1) for all l to satisfy the first condition. 
However, when some of the terms are negative, a simple algorithmic approach can be used 
to determine whether there exists a valid assignment of rg. In fact this condition is completely 
source dependent, and the choice of {ij£,£ = 1, 2,..., L} is unique up to a negation (assuming any 
component TJ? is not completely independent of the others), and thus can be considered fixed for a 
given source observation covariance matrix. 

This theorem 


The proof of this theorem also has two parts given in Section 3.1 and Section 3.2 


answers the first question regarding the conditions to certify whether an uncoded scheme is optimal 
in this communication problem. The answer to the second question for this problem turns out to 


be simpler than that in the broadcast case, and we discuss in Section 3.3 as special case examples 
several problems previously considered in the literature. 


3.1 Extracting the Critical Conditions from the Outer Bound 


Define 


and thus 


E(S m - S m ) 2 = A m , m = 1, 2,..., M, 


^S 2 m = a 2 Sri 


— A r 


m = 1,2,, M. 


(49) 


(50) 


The reason to introduce S m ’s is that in the remote coding setting, the distortion can be decomposed 
into two independent parts: the first part is due to encoding the observable part of the underlying 
sources, which are S random variables, with a distortion, and the second is due to the inherent 
noisy nature of the observations which induces a fixed distortion A m . Thus encoding the source 
S m to distortion D m is equivalent to encoding the equivalent source S m to distortion D rn — A m . 

We can now derive an outer bound by combining the approach used in the broadcast problem 
with a technique based on Witsenhausen’s bound 21 . Again consider M auxiliary zero-mean 
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Gaussian random variables (W\, W 2 ,.. ■, Wm) with covariance matrix Ewi,w 2j ...,Wm> which are 
independent of everything else, and write 

U m [n] = S m [n ] + W m \n], m = 1,2,... ,M. 

Notice the Markov string 

(U? , U?, ...,u£)+* (Sf, S?, (if, if, ■ • •, if) ** (XF,X?, 

and we can write using data processing inequality that 

I(X?,X?, ■ ■ •, ; Y n ) > I(tf, C/f, ..., Y N ), 

where equality holds if and only if 

h(Y N \X”, X f, ... ,Xf) = h(Y N \U», U?, ..., U£). 

Following the exact steps as in [7] (see also [8]) and applying Witsenhausen’s bound 121 


(51) 

X%)<*Y, (52) 

(53) 

(54) 


can obtain 


where 


I(X?,X' 


•-N 


,x?-,y n : 


N, ( P 
< 17 log 1 + -s- 


CTr, 


1= 1 


L 

E 

i=i e'=t +1 


P — SjPe + 2 p} t ,5(6p \J PfPfi. 


we 


(55) 


(56) 


and pE, = |'i/’£t'(V , ^,tV’£ , ,£') _5 l- This inequality intuitively says that the mutual information between 
the channel inputs and the output is upper bounded by the capacity of a point-to-point channel, 
whose power constraint is equal to the resultant signal power when all the inputs on the multiple- 
access channel are coherently added. We will not attempt to further simplify this condition at this 
point, since in the context of the uncoded scheme, it has a particularly simple form. 


The right hand side of (53) can be bounded similarly as in the broadcast problem. Here the 


equivalent source is (Si, S2 ,..., Sm), and the distortion vectors are (D\ — Ai, D 2 — A2 ,..., Dm — 
Am), and moreover, 0 % = a 2 z for m = 1, 2,..., M. We thus arrive at 


> ^log l% ' A . S M + *w t ,w 2 . w „I 


n" = 1 (An-A m + a: 


Wrr 


where equality holds if and only if 


N . 


h{UZ\Y N ) = y log[27re(An - A m + a^J], m = 1 , 2 ,. 


, M, 


h(UZ I Y n , tf, Un, ..., UZ^) = h{UZ\Y N ), m = 2,3,..., M. 


t n 


Ni v N\ 


(57) 

(58) 

(59) 


An outer bound is then obtained by combining (53), (55) and (57). Again the precise form of 


this outer bound is less important than the extracted matching conditions (54), (55) being equality, 


(58) and 


The condition (55) being equality and the condition (58) can be satisfied simply 


by choosing a proper jointly Gaussian coding scheme, and the conditions (54) and (59) are almost 
identical to © and fhij) in the broadcast case. 


3.2 The Forward Matching Conditions 


Since the uncoded scheme takes single letter encoding function, (|55|) being equality is equivalent to 

I(X i,X 2 , 


1 P 

,X l ;Y) = - log 1 + — 
z V °z 


(60) 
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Because in the uncoded scheme the channel input X is given in (45), the equality holds as long as 

>0, 1 <£<£'< L. 

This yields the first condition stated in Theorem [2] 

The conditions (54) and (59) in the context of uncoded scheme are equivalent to 

h(Z) = h(Y\U 1 ,U 2 ,...,U M ), 

, Um-i) = h(U m \Y), m = 2,3, 


h(U m \Y,U 1 ,U 2 , 


Denote 


i =i 


For (62) to hold with equality, two conditions must hold 

E[X\S u S 2 ,...,S m ]=X, 

and 

E[X\U 1 ,U 2 ,...,U m ] = X. 


(61) 

(62) 

(63) 

(64) 

(65) 

( 66 ) 


Let us consider the first condition (65). Due to the jointly Gaussian distribution, there exists a 


set of coefficients (aq, a 2 ,... ,olm) such that 
E[X|Si, S 2 ,..., Sm] = 


M 

E 

m= 1 


M L 

Ot-mSm = CX-m 


m= 1 


£=1 




However notice that 


* = E 


i=i 



thus the condition (65) is equivalent to the fact that the vector 

( Swi 


Pi 


ipi,i 


,$2V2\ 


P2 


Ip 2‘ 


,$LVL1 


Pl 

' t pL,L 


(67) 


( 68 ) 


(69) 


is in the row space of the matrix T. Equivalently, the vector 


8im\ 


ipi,: 


-,8 2 V2\ 


Pl 


^ 2,2 


. n 

needs to be in the row space of the matrix E(s 1j s 2j ... ) s m ) i (t 1 ,7] 2 ,...,T£)' This leads to the second 
condition stated in Theorem[2] When this condition is satisfied, the coefficients a can be determined 
exactly as in 


The conditions (63) and (66) are now identical to the broadcast case with Si, S 2 ,, Sm being 
the sources and X being the channel input. By Corollary 2, such a channel is matched when the 
second largest eigenvalue of the matrix LIE 


S u S 2 ,-,Sm 


n is less than 




or in other words, the 
noise power must be above or equal to the given threshold stated in Theorem [2j 

Remark: The first condition in Theorem [2] generally has a unique solution if it can be satisfied, 
up to a negation of all the signs of the channel input signals. The second condition can almost 
always be satisfied by choosing appropriate a (<5i, 5 2 ,..., 5l) vector, except a few special cases where 
an all positive solution does not exist (recall we have assumed 5e > 0, and thus only all positive 
solutions are valid). If the third condition is satisfied for certain source-channel-code triple, then 
it is satisfied for any more noisy channels. It is seen that the critical conditions in the outer bound 
derivation essentially decouples the matching problem into several simpler ones, leading to the three 
largely independent conditions given in Theorem [2j 
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Figure 5: The scalar Gaussian CEO problem on a Gaussian multiple-access channel. 

3.3 Matched Channels in Special Case Scenarios 

In the multiple-access setting, the conditions for matching in Theorem [2] are already rather simple, 
and there is no need to further investigate the properties of matched channels as in the broad¬ 
cast case. Next we consider two special cases in the general problem setting which extend those 
considered in [7] and jsj, respectively. 


3.3.1 The Scalar CEO Problem 

Consider a zero-mean scalar Gaussian source 5[n] with variance There are a total of L sensors, 
whose observations are 

T £ [n] = d e S[n] + Z' t [n],e = 1,2,... ,L, (70) 

where d £ > 0 (without loss of generality) and Z' £ [n] ’s are the zero-mean independent additive noise 
with variance a\,. This special case is depicted in Fig. [5J 

It is clear that the first condition in Theorem [2] is satisfied by r\ £ = 1 for all t = 1,2,..., L. The 
second condition for this case is equivalent to 


' 5l \/l)’' 52 \/^’'"’' Si VSl) ST ‘' T2 . T L Oc(d U d 2 ,...,d L ), 


(71) 


where oc here means a component-wise proportional relation. In other words, the uncoded scheme 
is optimal if 


S £ JPi(djcr 2 s + erf,) + y 2 2 didder's oc d £ . 

V+j, V a i’°s + a z> 


I’+t 

However, the LHS of the above condition can be simplified to 


Pi 


d Ws + °\> 


I ~Pv 2 

+ d £ 2 _^ 0£'d £ 'J 2 2 1 _2 G Si 
£ / =1 V a t' a S a z> 


(72) 


(73) 


where the second term is proportional to d £ , and the first term is proportional to d £ if and only if 




= const, t = 1, 2,..., L. 


(74) 


(dja 2 + a 2 z ,)dj 

It remains to check the third condition, however in this case M = 1, and the second eigenvalue 
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Figure 6: Sending correlated Gaussians on a Gaussian multiple-access channel. 


of the matrix IIE^ ^ ^ II can be viewed as zero, thus any noise power a z will allow a matching. 

Summarizing the above analysis, it is seen that for the scalar CEO problem on a Gaussian multiple- 


access channel, as long as the condition (74) holds, the uncoded scheme is optimal. Conversely, for 


any noisy observation qualities, there always exists a matched channel by choosing the values of 5^ 
properly. 


The condition (74) corresponds to a proportional quality requirement: the quality of the obser¬ 


vations need to match the transmission powers and the transmission amplification factors. Gast- 
par (r] showed that when all the sensors have the same observation quality, the same power and 
the same amplification factor, the uncoded scheme is optimal. Our result thus generalizes it to the 
proportional case. 


3.3.2 Correlated Gaussian on a Gaussian Multiple-Access Channel 

Consider the case when M = L, and we shall assume that the first condition in Theorem [2] can be 
satisfied. The second condition is also satisfied trivially since the matrix 

is full rank in our problem setting. Thus only the last condition needs to be checked in this case. 
Equivalently, when A2 is strictly less than 1, there always exists a noise power a‘ z such that the 
channel is matched and thus the uncoded scheme is optimal. 

Lapidoth and Tinguely |8] previously considered the case that T m = S m , m = 1, 2,..., M; see 
Fig. [6j It was shown that for covariance matrix E Si,S 2 ,—,S M with strictly positive entries, there 
always exists a noise power a z such that the uncoded scheme is optimal. Our result generalizes 
theirs to the case that the observations can be noisy linear combinations, and the covariance matrix 
^5 i,S 2 ,...,Sm does not necessarily all have strictly positive entries. 


4 Conclusion 

We considered the problem of determining whether a given uncoded scheme is optimal for multiuser 
joint source-channel coding. It was shown that for both broadcast and multiple-access in the 
Gaussian setting, matching occurs naturally under certain general conditions. Our approach differs 
from the more conventional approach in that instead of attempting to find explicit outer bound 
and inner bound then compare them, our focus is on the critical conditions that make the outer 
bound hold with equality. This approach has a decoupling effect which tremendously simplifies the 
overall task. As future work, we plan to extend and generalize this approach to explore matching 
in other channel networks. 
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Appendix 

Proof of the Outer Bound in Theorem [7J To upper-bound E(T 1 w 1 ,W 2 ,-,w M )-> reca ll the Markov 
string 

Y i ++ Y 2 n +> .. . Y» <+ X N +> ( S? , S ? ,..., S% ) 

o(C/f,C/ 2 w ,...,^)o(C/f,C/ 2 Jv o...oC/^_ 1 )o...oC/ 1 iV . (75) 

We start by writing the following: 

m 

'£W?;yI‘\uF,u 2 k ,...,u» 1 ) 


3 = 1 


= [1(11?, Uu™- Y?) - I(U?, U?,YJ 1 )] 

3 = 1 
m 

= £ [HYf \uf,U ?,,) -M>f K,t/f,■ ■ ■,Cf/)] 

J = 1 

m m 

= J2 h ( Y j N \Ui, U ?,..., iPf, U?,U?). (76) 

i=i 3 = 1 

Since physical degradedness is equivalent to stochastic degradedness in the broadcast setting, ie. ; 
Zj can be assumed to be decomposable into two independent components as Zj + \ + A Zj, we can 
apply the entropy power inequality fl8] for j = 1,2,..., M — 1, 


exp 


i-MY?\u?,u?,...,u?) 


N\ 


N 


> exp 


= exp 


ZK Y ^\u?,u?,...,u?) 


N\ 


N 


+ exp 


log(27re(a|. - a|. +1 )) 


-h(Y? +l \U(\U?,...,U?) 


+ 2ite(<T 2 z . — cr| j+1 ). 


For j = M, it is clear that 
2 


exp 






A 


> exp 


h(V N \Q N Q n Q-/V \ 


TV' 


iV 


= 27re(j 


Zm ’ 


with equality if and only if 

h(Y$\U?, U?, ...,U%) = h(Y»\S? , S? ,SZ). 

It now follows that 

e { y Wi,W 2,...,W m ) 

M 


(77) 

(78) 

(79) 


- X] ( a Zr, 

m= 1 
M 

- X/ ^r, 

m= 1 


< 7 z rn+ i) ex P 


4 

Zjn 


N 




3 = 1 


exp 

w T,T=i H y 3 n \ u i, u Z, 

< 


nr=i 

exp^h^lt/f,^,...,^ 

+ 2ire(cr' 2 2 

- CTy ) 

j z,+iq 


(80) 


where for convenience exp [-^/i(Y^ + i|S , ) v , 5 2 V ,..., 5^)] A 0. 

We upper-bound this summation, by considering the summands in the reversed order, i.e., 
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m = M. M — 1,..., 1. Starting with the summands when m = M — 1 and m = M, we have 


(di — a 2 z ) - 


+ a z A 


exp 

f Ejil 1 H y j N \u?, u?, 

> 1 

IT 


n^ 1 

exp 

0 

3Xp 

-,up) 

+ 2ire(crl 

~ <j\ ) 

3 Z 3 + l'J 

I Lj=i 

exp 

[w h ( Y jli\Ui, U?,Uf)) 

+ 27re(<7|. - a 2 Zj+i ) 


exp 


1 < 


n U 1 

exp 

[ Y h{Y^\u^u^...,u T )) 

+ 2?re(cr|. - <r|. +1 )_ 


.2 _2 ^ , _2 eX P 


(%-! ~ %) + ^A 


27recr7 


1 

exp 




27re ttM -2 
n T=l 

exp(^ i (^ 1 |[/ i V/^,...,^)) 

+ 27re(cj7 — a?- ) 

v ZjM — 1 Am' 


(81) 


Continuing this line of reduction, we finally arrive at when m = 1 


< (^L — ^li 


exp [jfh{Y\ N )} 


+ 


1 exp 




TV | tt N 
'1 ) 




exp (^/iQ^l^iO) + 2vre(o-| 2 - ctIJ 2 vreexp (^/iQ^l^iO) + 2ne ( a z 2 ~ a h' 


exp [jjhiY^)] 


exp (^h(Yf\U^))) + 27re(cr| 2 - a 2 Zi ) 
exp [jjh{Y L N )] 


( a z 2 ~ a z 1 ) + 


exp [jfh{Y 2 N \U?)\ 


27re 


< P + cr z , 


(82) 


27T6 “ ‘ ' ^ 1 ’ 

where the last inequality is by the concavity of the log(-) function and the given power constraint. 
The chain of inequalities in (82) holds with equality holds if and only if 


K Y i) = v log2vre(P + a 2 Zl ), 


N 


as well as (79) and the entropy power inequalities hold with equality. 


We next lower bound E(Ewi,W 2 ,...,w m )- By the rate-distortion theorem 18 

r 2 


N 


° Sl + °\ 


Ur 


I{U?-yF)<~- log 

2 D + a u 1 


with equality holds if and only if 


N 


h(U?\Yf) = -log{27re(D 1 + at Vl )]. 


(83) 

(84) 

(85) 
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Furthermore, 

= h(U»\U», u ?,..., U^) - h(U%\ y£, uf, u?,..., U^) 

_ N 1 „„ \2ne(Y,s 1: S2,-,Sm +'£wi,W 2 ,...,Wm)\ ufrrNwN ttN tt N ttN ^ 

— TT °o 77 777 ~77 77 — ) U 1 i u 2 i ■ ■ ■ i u m -lJ 

2 |27re(L Sli s 2) ... iSm _ 1 + Evy 1 ,iy 2 ,...,w m _ : J| 


> ^ lo \2Ke(T, Su s 2 ,-,Sm + s Wd,vy 2 ,-,iy,JI 
2 |27re(E5 li 5 2! ... ; 5 m _ 1 + 


-h(c/^|yj) 


> — loe l 27re ( S -5i,S 2 ,...,S m + X Wl ,W 2 ,...,W, 
-2 S 


N 


rv , v v - y log[2vre(F) m + a^J] 

l 27re (^Si,5 2 ,...,5 m _i + E H / 1 ,m 2 ,...,VF m _i)| 2 


( 86 ) 

(87) 


w„. 


= N l 0 g__ 

2 l( S Sl,Sm -1 +' S Wl,W 2 ,...,Wm-l)\[ D m+ a W m \ 


where (86) is because conditioning reduces entropy, and (87) is because Gaussian distribution 
maximizes the entropy for random variables with the same variance, together with the concavity 

( 88 ) 


of the log function. For (86) to hold with equality, we must have 

h(U%\Y£, U?, t/f,..., U^) = h(U%\Y»), m = 2, 3,..., M, 


and for (87) to hold with equality requires 


N 


h{U m | Y m ) = — log[27re(G m + cr w J], m = 2, 3,..., M. 


It follows that 


N 


exp 

JV 

3 = 1 

Combining (|82|) and 




> 


\^Sl,S 2 ,...,Sm + ^W U W 2 ,...,Wn 

n? =l (D j + a>) 


we reach an outer bound 


M 


E (J 1 J 2 J S Si,S 2 ,...,S m + £m 1 ,VK 2 ,...,W m | ^ D , _2 
- °z m+1 ) rrm In. A. ^2 7 S r + <r Zl - 


m= 1 


n )=i( D j + (T 


w,- 


(89) 

(90) 

(91) 

□ 


B[ 0) > 5® > ... > B$ > 0. 


Proof of Lemma 1. For simplicity, let us define Bm = a 2 x , Y for m = 1,2,..., M. It is clear that 

(92) 

Recall a m ^ 0. In the fc-th step of the Cholesky decomposition k = 0,1,..., M — 1, we claim 

that oiM—kpM—k > 0 and Ylf=i k l a iPi — 0- Moreover, we claim the matrix partially diagonalized, 
(k) 

denoted as v has entries in the following form: 

(k) 

• 7 Y = 0, j > M — k and i j: by symmetry, 7 ij = 0, i > M — k and i / j. 

• 7m,'In = 171 > M — k; 

• = —/ 3if3jBj k \ j < M — k and * < j; by symmetry 7 ij = —/3iPjB^ k \ i> M — k and i > j; 


ry(k) - /T, 

7m ,m ~ „ 


T~>{k) v—\m—1 n , \-^M — k n 7->( 

Bm Z)i=l a jPj + Yhj=m +1 


, m < M — k. 


where the terms (_Eq fc \ ■ • ■, B^) are determined recursively as 

BW = Bi fc - 1 ), m > M — k, 


(93) 
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g ( k +U = 


z>( k ) i oiM-kpM-k r>(,k) a sr^M-k -1 „ a _j_ n 

+ E « r n „*"«-*> Qi »* U m < M — k. (94) 

B' m , otherwise 


for which 


B[ k) > B ( 2 k) > . .. > . (95) 

Clearly the claim is true when k = 0. Suppose it is also true for k = k *, and we wish to prove the 
claim for k = k* + 1. 

It is clear that due to the positive semidefinite requirement for the degenerate case when 

P M—k* — l 

(k*) _ PM-k* a _ n 

’ CX.M-k* ^ 

3=1 


we must have for i < M — k* 


"l LM-k* ~ PiPM-k* ~ 0, 


and this Cholesky step can essentially be skipped, and (B[ k \ B 2 k \ ... ,B^) does not need to be 
updated. It is easy to check the recursive formula 7 m,m J for m < M — k — 1 is indeed valid for 
this case. If /3 M-k * = 0 , then clearly YlpPi* 2 opPi = ^2=2 1 a iPi > 0 due to the assumption 
in the induction. If pM-k* / 0 then = 0 for i < M — k*, and thus 'Y2^ k ~ 2 a iPi = 0- Thus the 

induction is valid in this case. 

(k*) 

If M-k* P 1 9) then due to the assumption in the induction we have 

M-k*- 1 

0-M-k*^M-k* > 0 , ^2 a jPj > 9 - ( 98 ) 

3=1 

First observe that due to the assumption in the induction, we have 

B[ k * +1) > B { 2 k * +1) >...> fl2T +1) > °- (99) 

Using the Cholesky factorization, we have for any j < M — k* — 1 and i < j 

(k* + 1) (fe*) a a u (k*) &M-k*Pj 

Ti,j = Ti,j - PiPM-k* 44- ^M-k*- 1 —T 

£i=1 a tPt 

_ a a dU'*) a q d(&*) (%M—k*Pj 

- -PiPjBj - PiP M -k*B M _ k , M _ k ,_ x -— 

£t=i 

_ (5 (5 r>i k *) 1 O! m— k*P m— k* j y( k *) 

- PiPj -D n M-k* 

£t=1 




(**+l) 
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Similarly for m < M — k* — 1 

-(**+!) = (k*) _ o2 a +&*) _ aM ~ k * _ 

Im,m lm,m h'mr'M—k ■ L 'M—k* sr^M—k* — 1 n 

z2t =i “tft 

m—1 M—k* 

5=1 j=m+l 


Pm 

Ot-m 


_ q 2 a p>( k *) _ a M-k* _ 

PmPM-k* D M-k* ^M-k*-l 0 

E,-=i a iPj 


U-m _ Ctrn. 


771—1 


Pr 


M—k* — l 


j.R. 5+*) 


5=1 


J =771+1 

\M—k* — l 


~ sr^M—k* — 1 /Q /Q 

„ Pm £—/j=l a jPj ~ a mPm (k*) 

+ a A l-k*PM-k*~ v-^M—fc* —1 o B M-k* 

Qm Ei=l <XjPj 


Pm 

Q-m 

+ 

fim 


B (k*) + Ej=1 &M-k*PM-k* R (fc*) 


''TO—1 

:1 _ 

E M—/c* — 1 /Q 

t=l atft 


M—k* 


m— 1 

S “ift 

5=1 


Pr, 


CXr 


M—k* — l 


£ d*' + 


J =771+1 

m—1 


) , YJjLl a M-k*PM-k* (fc*) 
j + ' M -k*-i R — 

Et=i 


M—k* — l 


b£‘ +1 ) £“^j+ £ “jfta 


,(fc*+l) 

5 


5=1 _;=m+l 

Suppose a.M-k*-iPM-k*-l < 0; this implies that 
M-k*-2 M-k *-1 

y = y — aiM-k*-iPM~k*-i > o 

5=1 5=1 

which however contradicts with the positive semidefinite requirement that 

M—k*—2 


Pu-k *-1 

& M-k *-1 


y > °- 


( 101 ) 


( 102 ) 


(103) 


5 = 1 


If aM-k*-iPM-k*-i = 0, then from the assumption in the induction, we have Ej=7^ 2 a jPj = 

Ey=7 fc _1 ck_ 7/3_7 > 0 thus this case does not cause any problem. If a.M-k*-iPM-k*-i > 0, then it 
also follows that Ej=7 / ' _2 a jPj > 0- The lemma is proved. 


□ 


Proof of Corollary^ 7} It suffices to consider the case that cr^ + = + m , m = 1,2,..., m* — l,m* + 


Per 2 


P(j\ 


P+<7 2 P+tJ 


1 ,,M, and <r^ + = Denote AP = 

the two channels as £y, ,v 2 ,...,v M and 5+ y 2 y , respectively. It is clear that 


+ , and matrices constructed for 


,V 2 ,-,Vm ~ s Vi ,V 2 ,-,V M ~ 


(^°i m * P m * AP 0 ... —PiP m *AP \ 

&-a m *p m *AP ... ~PiP m *AP 


0 


V PlPm* AP -P 2 Pm*AP ... 


(104) 

However, it is easily seen that this matrix is positive semidefinite since the first m* — 1 diagonal 
terms are non-negative, and we can remove all the other terms through symmetric elimination, ie., 


22 




















the Cholesky factorization. It follows that 

= pyj ,v 2 ,...y M - s vi ,V 2 ,...,v M \ + [ T ‘V 1 ,v 2 ,...y M ~ s 5i,s 2 ,...,5 M +P^P t ] 

is positive semidefinite since it is a summation of two positive semidefinite matrices. 

Proof of Corollary [1| First note that the entries in matrix II, 


M 


'y ] Pj,i a i — PPji i — 1)2, 


, M. 


(105) 

a 


(106) 


Z=1 


For the “only if” direction, it follows from Corollary 1 that matching must hold for the degraded 
channel with noise power a 2 z , = a 2 z , = ... = a 2 z , = a 2 z = a 2 Zi . The requirement (5) implies 


p + a 2 


diag (h, to,( 

V«1 a 2 OLM J \ 




P + a 2 


Pft h X Slj s 2t ...,s M - 


(107) 


(To 


P 


P + a 2 J M + P + a 2 


This implies that fa > 0, since otherwise the left hand side is rank deficient. Together with Lemma 
1, it follows that aif3i > 0. Next multiply both sides from left and from right by II, it follows that 

/ V<xi/3i \ 

^ a2 ^ 2 {V a lJh V a 2@2 V q M^m) h D^S 1 ,S 2 ,-,S m P- (1° 8 ) 

Notice that v\ = {\fa\E\. \/a 2 ^ 2 , ■■■, V^mPm) is in fact an eigenvector corresponding to eigenvalue 
1 for the matrix nE 5 li 5 2 r .. ; 5 M II, easily verified using Q. We can write the eigen decomposition of 
the matrix nEs' li g 2 j ... j s M II as 

M 

UT, Si ,S 2 ,...,Sm U = Viv\ + ^2 ^iViV*, (109) 


i=2 


where A 2 , A 3 ,..., A m are the other eigenvalues of IIEs li g 2 v .. i g M n, and V 2 , V 3 ,..., vm are the corre¬ 
sponding eigenvectors. It follows that 


(To 


P + a 2 


Pm h 


2 M 

° Z viv\ + ^2X iVivj, 

z i=2 


P + a 2 


( 110 ) 


which implies A i < 


p+°%' 


i — 2,3, 


, M. 


For the “if” direction, we choose a a 2 z such that (110) holds, which is always possible when a 2 z 
is sufficiently large. This implies that for the channel a 2 Zx = er | 2 = ... = a\ M = a 2 z , condition 
(107) holds, and thus it is a matched channel. □ 

Proof of Corollary [3| The entries of matrix diag(d)E^ 1 ) ^ 2 j ... i ^ M diag(d), denoted as <f>ij, is given 
(by symmetry only the upper-triangle entries need to be specified) 

P 2 


(pj.rn — CXj (PjOCmPn 


and 


m —1 


= a 7 


i (Pm a j(Pj 
3 = 1 


Pa 2 

_ Am 

P + a z 

Art 


P + a 2 

Art 


M 


OLjOLmPjjmi J ^ 


( 111 ) 


T (TmfPm y ) (Tj /A 


Pao 


■ ^ p + °z 

j=m +1 ^j 


a mPm,m + a m (P m P- (H2) 


A necessary and sufficient condition for matching is that the matrix diag(a)Ew 1 ,w 2 ,...,WM < liag(a) 
is positive semidefinite. 
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Observe that 


M M 

^ '] &j,m — C^mPmP ^ ^ ®-jPj QmPmP — 0- (H3) 

j =1 i=l 

If all the off-diagonal entries of diag(d)SvUi,W 2 ,...,vr M diag(aO are non-positive, then the matrix is 
diagonally dominant, and the diagonal entries are all positive, which implies that it is a positive 
semidehnite matrix. Thus as long as 

P 2 


and 


a j Pj&mPr 


Otj fijQtmPn 


P + a 


P 2 


2 — Oj (l ln f>j : jn ■ j <C TTl 


P + a 


2 — tXjOimPj.m-, j + ^ 


the positive semidehnite condition is satished. It is thus sufficient to have 


a 2 Zm > max -^-/3 m P 2 - P, m = 2, 3 . 


, M. 


j< m Pj,m 

Together with Corollary 1, this implies the statement given in the corollary is indeed true. 


(114) 

(115) 

(116) 
□ 


Proof of (4-1). Since the matrix Y,Si,S 2 ,Sz is positive definite, we have — 1 < p\ < 1 and — 1 < p 2 < 1. 
Since a m = 1, we must also have (3 m > 0, 0 < A 2 < 1 and 0 < A 3 < 1 for matching to occur. The 
first condition gives that 

Pi + P 2 + 1 > 0 and 2pi + 1 > 0, (117) 

but the latter two require a few more steps. Notice that the condition 0 < A 3 < 1 implies that 

pi + 2 p 2 > 0 . (118) 

If P 2 > 2p\ — 1, then 0 < A 2 < 1 implies 

2 Pi P'2 > -4 p\ - 3/91. (119) 

If pi > 0, this yields a condition already implied by pi + 2 p 2 > 0; on the other hand, pi < 0 is an 
impossible case. It can be verified that p 2 < 2 p\ — 1 is also an impossible case. Thus we must have 
P 2 > 2 p\ — 1 and pi > 0 simultaneously, from which we obtained the set of conditions given in (41). 

□ 
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